Amendments to the Claims 



1 to 56. (Canceled) 

57. (New) A method for producing an enhanced spatial television-like viewing 
experience utilizing conventional video devices for the provision of the source media, 
comprising: 

(a) updating an overall image sphere on a page-by-page basis in real time 
utilizing conventional video devices for a provision of the source media; and 

(b) producing graphical imagery depicting a panoramic image composed of a 
plurality of smaller image subsections. 

58. (New) The method of claim 57 wherein producing graphical imagery comprises 
providing a panoramic image with a 360 degree horizontal view. 

59. (New) The method of claim 57 further comprising determining a page order by 
additional information present in the source media. 

60. (New) The method of claim 57 further comprising viewing prerecorded 
audiovisual media in a wide screen format such that the width of the virtual screen 
extends to a full 360 degrees horizontally and up to 180 degrees vertically. 

61 . (New) The method of claim 57 further comprising viewing prerecorded 
audiovisual material on a conventional screen based display device such that the 
display device represents a viewport of the full 360-degree panoramic image. 

62. (New) An entertainment system comprising: 

(a) a plurality of media provision devices of different types; 

(b) a VTV processor responsive to video data from the media provision devices 
to generate panoramic video imagery therefrom; and 
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(c) a display device responsive to panoramic video imagery from the VTV 
processor. 

63. (New) A method for producing audiovisual effects comprising modifying an 
original television protocol to accommodate transmission of at least one of graphical 
data, sound information, and control information in each frame without breaking 
compatibility with the original protocol. 

64. (New) The method of claim 63 wherein the modified protocol allows for, within 
at least one scan line of a video image transmitted in accordance with the original 
protocol, at least one of additional digital coded data and analogue coded data for 
providing information which defines control parameters and image manipulation data for 
a VTV graphics processor. 

65. (New) The method of claim 64 wherein the scan line further includes additional 
digital data and analogue coded data which provides information to generate four or 
more real-time audio tracks. 

66. (New) An electronic device comprising: 

(a) a plurality of video image display devices; 

(b) means for producing an enhanced spatial television-like viewing experience 
utilizing the devices; and 

(c) means for a viewer to view audiovisual media in a wide-screen panoramic 
format such that the viewable area extends to a full 360 degrees horizontally and 
up to 180 degrees vertically. 

67. (New) An electronic device comprising: 
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(a) means for producing graphical imagery depicting a panoramic image such 
that the overall panoramic image is composed of a number of smaller image 
pages; and 

(b) means for updating the panoramic image on a page-by-page basis in real 
time. 

68. (New) The electronic device of claim 67 further comprising means for 
determining an order of image pages by additional information present in the source 
media. 

69. (New) The electronic device of claim 67 further comprising a screen-based 
display device, wherein the viewer can observe a portion of the full panoramic image on 
the device. 

70. (New) The electronic device of claim 67 further comprising a virtual reality type 
display device, wherein the viewer can observe a portion of the full panoramic image 
through the device. 

71. (New) A propagated audiovisual signal comprising a plurality of frames that 
each include at least one of graphical data, sound data, and control information, 
wherein the signal is compatible with at least one widely accepted television standard. 

72. (New) The propagated audiovisual signal of claim 71 further comprising, within 
one or more scan lines of a standard video image, additional coded data defining 
control parameters and image manipulation data for a VTV graphics processor. 

73. (New) The propagated audiovisual signal of claim 71 further comprising data of 
a panoramic image sphere. 
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74. (New) The propagated audiovisual signal of claim 73 further comprising, within 
one or more scan lines of a standard video image, additional coded data providing 
information as to relative placement position of a current video field or frame within the 
image sphere. 

75. (New) The propagated audiovisual signal of claim 71 further comprising, within 
one or more scan lines of a standard video image, additional coded data providing 
information for generation of four or more real-time audio tracks. 

76. (New) The propagated audiovisual signal of claim 71 further comprising, within 
one or more scan lines of a standard video image, additional coded data providing: 

(a) audio information for generation of four or more real-time audio tracks; and 

(b) data descriptive of a number of employed audio tracks, an employed audio 
data format, an employed audio sampling rate, and track synchronization; 

whereby a VTV graphics processor can decode the audio information into position 
and orientation sensitive sound. 

77. (New) The propagated audiovisual signal of claim 71 further comprising, within 
one or more scan lines of a standard video image, additional coded data which 
provides information as to absolute orientation and X-Y-Z position of a camera. 

78. (New) The electronic device of any of claims 66, 67 or 70 further comprising: 

(a) means for mathematically combining information about azimuth and 
elevation of a viewer; and 

(b) means for encoding multi-track audio for use with standard video storage 
and transmission systems such that the combined information can be 
subsequently decoded by specific hardware to produce a left and right audio 
channel with spatially correct three-dimensional audio for the left and right ears 
of a viewer. 
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79. (New) The electronic device of any of claims 66, 67 or 70 further comprising 
means for varying the azimuth and elevation of the viewport within the panorama 
responsive to runtime user control. 

80. (New) The electronic device of any of claims 66, 67 or 70 further comprising 
means for varying the azimuth and elevation of the viewport within the panorama 
responsive to continuous measurement of azimuth and elevation of a viewer's head. 

81 . (New) The electronic device of any of claims 66, 67 or 70 further comprising 
means for varying angular field of view of the viewport within the panorama responsive 
to runtime user control. 

82. (New) The electronic device of any of claims 66, 67 or 70 further comprising 
means for varying a viewpoint within a three-dimensional virtual space responsive to 
runtime user control. 

83. (New) The electronic device of any of claims 66, 67 or 70 further comprising: 

(a) a tracking device for continuously measuring a viewer's physical position; 
and 

(b) means for varying a viewpoint within a three-dimensional virtual space 
responsive to the measurement. 

84. (New) The electronic device of any of claims 66, 67 or 70 further comprising 
means for providing orientation-sensitive audio in real-time, controlled by a direction of 
a viewer's head. 

85. (New) The electronic device of any of claims 66, 67 or 70 further comprising 
means for providing orientation-sensitive audio in real-time, controlled by coordinates of 
a viewport within the panorama. 
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86. (New) The electronic device of any of claims 66, 67 or 70 further comprising 
means for providing orientation- and position-sensitive audio in real-time, controlled by 
coordinates of a viewport within the panorama and virtual position of a viewpoint within 
a three-dimensional virtual space. 

87. (New) The electronic device of any of claims 66, 67 or 70 further comprising 
means for combining prerecorded computer graphic or live imagery with real-world 
imagery captured in real time by a camera system, whereby an augmented reality 
experience is produced. 

88. (New) The electronic device of any of claims 66, 67 or 70 further comprising 
means for analyzing real-world images captured by a camera system and, via 
differential imaging techniques, automatically replacing background real-world scenery 
with synthetic or prerecorded imagery provided from a video device. 

89. (New) The electronic device of any of claims 66, 67 or 70 further comprising 
means for selectively combining and geometrically altering either real-world or 
prerecorded imagery to create a composite augmented reality experience. 

90. (New) The electronic device of any of claims 66, 67 or 70 further comprising 
means for combining foreground and background pre-rendered video information 
utilizing chroma-keying techniques, wherein: 

(a) the foreground and background information are provided by a common 
video source; and 

(b) the chroma-key color is dynamically variable within an image by provision of 
an analog or digital sample of the chroma-key color coded as one of a special 
control frame and a part of each scan line of the video image. 

91 . (New) A VTV graphics processor comprising: 
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(a) one or more video digitizing modules; 

(b) one or more memory areas from the group consisting of augmented reality 
memory (ARM), virtual reality memory (VRM), and translation memory (TM); 

(c) digital processing means for 

(1) altering address mapping of data held in at least one of ARM and VRM 
so as to effectively move graphical information from one location to another 
therein; and 

(2) mathematically combining and altering data from both a source and 
destination location, thereby achieving functions of compositing and 
transformation; and 

(d) one or more video generation modules. 

92. (New) The VTV graphics processor of claim 91 wherein ARM is mapped to 
occupy a smaller vertical field of view than VRM and TM, whereby data required for 
provision of the media whilst still maintaining a high-quality image is minimized. 

93. (New) The VTV graphics processor of claim 91 further comprising means for 
mapping ARM, VRM, and TM at different resolutions, whereby pixels in each memory 
region are capable of representing different degrees of angular deviation. 

94. (New) The VTV graphics processor of claim 91 further comprising: 

(a) means for displaying imagery; 

(b) means for placing real-world video information in ARM and source 
information from a video-provision device into VRM; and 

(c) means for combining the two sources of imagery according to a pattern of 
data held in TM into a composite image before display. 

95. (New) The VTV graphics processor of claim 91 further comprising: 
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(a) means for displaying imagery; 

(b) means for placing source information from the video-provision device into 
ARM and VRM; and 

(c) means for combining the two sources of imagery according to a translation 
map included in the source media. 

96. (New) The VTV graphics processor of claim 91 further comprising: 

(a) means for displaying imagery; 

(b) means for placing source information from a video-provision device into 
ARM and VRM; and 

(c) means for combining the two sources of imagery according to additional 
source information in accordance with geometric interpretation of the imagery. 

97. (New) A system comprising: 

(a) a plurality of electronic image capture devices configured with overlapping 
horizontal fields of view such that collectively the overlapping horizontal fields of 
view cover a full 360 degrees; and 

(b) means for cropping and aligning individual images produced by the devices 
to produce an overall 360-degree panoramic image with negligible distortion and 
overlap between the individual images. 

98. (New) The system of claim 97 further comprising means for applying distortion 
correction to the images, wherein the 360-degree panoramic image is mathematically 
flat in the horizontal axis, whereby each pixel in the horizontal axis of the image 
subtends an equal angle to a capture device. 

99. (New) The system of claim 97 further comprising means for applying distortion 
correction to the images, wherein the 360-degree panoramic image is mathematically 
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flat in the vertical axis, whereby each pixel in the vertical axis of the image subtends an 
equal angle to a capture device. 

100. (New) The system of claim 97 further comprising means for inserting 
identification information to describe the location of individual images that comprise the 
360-degree panoramic image into an outgoing video stream. 

101 . (New) The system of claim 97 further comprising means for inserting tracking 
information to describe a current orientation and position of the capture devices into an 
outgoing video stream. 

102. (New) A system comprising: 

(a) a video capture device; and 

(b) means for performing a series of image analysis processes to calculate, 
utilizing data received from the video capture device, change in orientation of the 
device. 

103. (New) A system comprising: 

(a) a video capture device; and 

(b) means for performing a series of image analysis processes to calculate, 
utilizing data received from the video capture device, change in position of the 
device. 

104. (New) The system of claim 102 or 103 further comprising: 

(a) a plurality of retroflective targets placed at predetermined coordinates; 

(b) a plurality of on-axis light sources strobed in synchronization with a capture 
rate of the video capture device; and 
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(c) means for computing absolute angular and spatial data based on the 
predetermined coordinates and relative angular and spatial data determined by 
the video capture device. 

1 05. (New) The system of claim 1 04 further comprising a plurality of color filters 
positioned over the retroflective targets whereby the ability of the system to correctly 
identify and maintain tracking of the individual retroflective targets is improved. 

106. (New) The system of claim 104 wherein the light are sources are color- 
controllable, whereby the ability of the system to correctly identify and maintain tracking 
of the individual retroflective targets is improved. 

107. (New) The system of claim 105 wherein the light are sources are color- 
controllable, whereby the ability of the system to correctly identify and maintain tracking 
of the individual retroflective targets is further improved, 

108. (New) The system of claim 102 or 103 further comprising: 

(a) a plurality of controllable light sources synchronized with a capture rate of 
the video capture device; and 

(b) means for utilizing at least one of pulse timing and color of light to transmit 
spatial coordinates of each beacon to the video capture device; 

whereby relative angular and spatial data can be determined by the device and 
converted into absolute angular and spatial data. 

109. (New) The system of claim 102 or 103 further comprising a plurality of bi- 
directional infrared beacons for communicating a unique ID code with the video capture 
device. 
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1 1 0. (New) The system of claim 1 02 or 1 03 further comprising: 

(a) optical imaging means for monitoring a visual pattern on a ceiling; 

(b) a plurality of fluid tilt sensors; and 

(c) means for determining relative spatial movement and azimuth via an output 
of the optical imaging means and for determining pitch and roll via an output of 
the fluid tilt sensors. 
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